Prof. Dr. Holger Rauhut

Professor

Department of Mathematics

Office address:

Theresienstr. 39

Room B420

80333 Munich

Office hours:

On appointment

Postal address:

Theresienstr. 39

80333 Munich

Prof Holger Rauhut

About me

I work on the mathematical foundations of information processing, i.e., machine learning and signal processing. I am particular interested in convergence theory for training algorithms (variants of gradient descent) in deep learning, in deep learning for inverse problems and in compressive sensing.

Keywords
Mathematics of Deep Learning | Compressive Sensing

Short Bio

  • 1996 - 2001 Studies of Mathematics (Diploma), Technical University of Munich
  • 2002 - 2004 Doctorate in Mathematics, Technical University of Munich, supervisor: Prof. Dr. Rupert Lasser, Title: Time-Frequency and Wavelet Analysis of Functions with Symmetry Properties
  • 2005 Postdoc, University of Wroclaw, Institute of Mathematics
  • 2005 - 2008 Postdoc, University of Vienna
  • 2008 Habilitation in Mathematics, University of Vienna, title: Sparse Recovery
  • 2008 - 2013 W2 Professor of Mathematics (“Bonn Junior Fellow”), Hausdorff Center for Mathematics, University of Bonn
  • 2013 - 2023 W3 Professor of Mathematics, RWTH Aachen University
  • Since 2023 W3 Professor of Mathematics, LMU Munich

Honors and Awards

  • 2010 ERC Starting Grant Sparse and Low Rank Recovery
  • 2022-2023 Spokesperson of Collaborative Research Center Sparsity and Singular Structures (SFB 1481), RWTH Aachen University

Research topics

Deep learning methods form the basis for modern applications of machine learning and artificial intelligence. Despite many successes and advances in a wide range of areas, the mathematical foundations are still only partially understood, and it is often unclear why the methods work or when they work. In particular, there is often a lack of rigorous mathematical guarantees for the success of learning algorithms. In my research, I aim to advance the mathematical understanding of deep learning.

I focus on several subfields of the mathematics of deep learning:

  • Convergence theory and impicit regularization for training algorithms
  • Deep learning methods for inverse problems
  • Uncertainty quantification for deep learning

Compressive sensing is a subfield of mathematical signal processing. The basic problem is to reconstruct signals using as few measurements as possible. Mathematically, this leads to solving an underdetermined system of equations. To make reconstruction possible, it is used that in practice signals are often compressible, i.e., they can be approximated well by a sparse vector. The theory of compressive sensing provides efficient reconstruction algorithms (e.g., l1 minimization). Interestingly, provably optimal measurement matrices (which describe the linear measurement process) are random matrices. For such matrices, guarantees can be given for the minimum number of measurements required (depending on the signal length and sparsity, i.e., the number of non-vanishing coefficients). Tools from high-dimensional probability theory are used for the mathematical analysis.

Publications